PATIENT RULE INDUCTION METHOD ON LARGE DISK 
RESIDENT DATA SETS AND PARALLELiZATION THEREOF 



The present invention relates generally to data analysis involving the prediction of 
high values of some output variable based on a set of input variables. In particular, the 
invention relates to analysis of large, disk resident data sets using the Patient Rule Induction 
Method (PRIM). 

BACKGROUND OF THE INVENTION 
A generic problem in data analysis involves the prediction of high values of some 
output variable based on a set of input variables. For example, a hospital might want to 
determine from collected patient data what combinations of patient age and length of stay are 
associated with high cost hospital stays. Adding to the complexity of this data analysis 
problem is the fact that the variables of interest can be of different types, including: 

continuous/numerical (ordered data, such as age, cost, length of stay); 

categorical (non-ordered data, such as doctor); and 

discrete (ordered, non-continuous data, such as procedure risk). 

There are many prior art strategies for solving similar data analysis problems to the 
one described above, including the SLIQ classification algorithm (M. Mehta, R. Agrawal and 
J. Rissanen, SLIQ: A Fast Scalable Classifier for Data Mining, Proc. of the Fifth IntT 
Conference on Extending Database Technology, Avignon, France, March 1996.), SPEC {An 
Efficient, Scalable, Parallel Classifier for Data Mining (1996) Anurag Srivastava, Vineet 
Singh, Eui-Hong (Sam) Han and Vipin Kumar, Technical Report 96-040, Department of 
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Computer Science, University of Minnesota, Minneapolis, 1996.), and the Patient Rule 
Induction Method (PRIM) (Friedman, J.H. and Fisher, N. L Bump Hunting in High- 
Dimensional Data (Oct. 1997) (to appear in Statistics and Computation). In each of these 
strategies, the data to be analyzed is stored initially in a database of any type and the data 
5 analysis system copies the stored data onto disk using specific data structures that facilitate 
analysis of the data. 

The SLIQ classification algorithm finds local groups of the input data that have a high 
output value. It works better with categorical data than with continuous data. That is, the 
10 SLIQ algorithm is more likely to find contiguous groups of multi-dimensional input data with 
high output values for categorical rather than continuous data. Because of this, the SLIQ 
algorithm is typically paired with linear regression analysis when continual data needs to be 
^ analyzed. 

Ql 5 The PRIM algorithm, on which the present invention is based, specifically addresses 

2 the issue of determining regions in a multidimensional space of a set of input variables that 

4- correspond to high average for an output variable. Moreover, the regions generated by PRIM 

are easily interpretable as they are rectangles for two input variables or (more generally) 
hyper-rectangles for more than two input variables. (Note, for the remainder of this 
^1^0 application, the terms 'liyper-rectangles" and "boxes" are used interchangeably.) A 
=,0 comparison of the results given by the SLIQ and PRIM algorithms for the same input is now 

described with reference to Figure 1 . 

Referring to Figure 1, there is shown a plot where the input variables are Length Of 
25 Stay and Age for hospital patients and the output variable is Charge for the patient's stay, 
where points that are filled-in are high value points and points that are not filled in are low 
value points. Given the goal of finding those regions of the Length of Stay/Age space with 
highest Charge, the PRIM algorithm would return the single hyper-rectangle 102, whereas the 
SLIQ algorithm would return the smaller, disjoint regions 104a, 104b. The PRIM hyper- 
30 rectangle region 102 description (e.g., 50 < Age < 70 and 2 <- Stay Length <= 4) can be used 
for prediction applications where the input variables are known and the output variable is 
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unknown In particular, for a hospital application, the high charge (or high cost) patients may 
be used to reduce costs internally or to negotiate more profitable contracts with payors (or 
insurance companies) externally. This application is facilitated by the simpler output of 
PRIM as compared to that from the SLIQ algorithm. As the present invention is based on 
PRIM, this method is now described in greater detail. 

The idea behind PRIM is to enclose all input data points within a single hyper- 
rectangle and then successively peel away contiguous, small strips of the hyper-rectangle 
enclosing low value points until a user-defined percentage of the total points remain inside 
the hyper-rectangle. These points are presumed to be predominantly high value points. 
PRIM can be applied to a small data set that can be copied in its entirety into main memory 
(i.e., RAM accessible to executing programs), but is not able to handle larger data sets. 
PRIM includes the following steps for continuous data: 

1) copy the entire data set into main memory; 

2) define a peeling fraction (a) which is the width of the contiguous, small strips of 
the hyper-rectangle. Each strip is formed by grabbing a given percentage of the initial points 
which is preferable between 1% and 5% of the points along the perimeter of the hyper- 
rectangle. 

3) form the strips along edges of the hyper-rectangle by taking a% of the points along 
the perimeter of the hyper-rectangle. 

4) calculate an average value of the cost attribute for each strip of the hyper-rectangle. 
For each attribute, sort the data and find the average value of the cost attribute for a% of the 
top points and a% of the bottom points. This is repeated for each attribute. 

5) throw away the strip with the lowest average cost value and return to step 3) - 
repeat until the number of points remaining enclosed by the hyper-rectangle equals a user- 
defined percentage of the initial points (the remaining points will be the user-defined 
percentage of points with the highest average output value). 

The steps for discrete data are similar to the previously described steps, except, 
instead of multi-dimensional strips, histograms are used. For example, if one of the input 
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variables were Doctor ID, each strip would correspond to a histogram bin for a given Doctor 
ID. The way PRIM is implemented for small data sets is now described with reference to 
Figure 2, 

Referring to Figure 2, there is shown an illustration of a data structure used by the 
prior art PRIM implementation for discrete attributes and a relational table of data. The 
relation table of data contains both continuous attributes and discrete attributes. To process 
the discrete attribute Doctor ID^ a histogram is generated containing all distinct Doctor Ids 
and an expected cost. The expected cost is calculated by summing the cost for each record 
with each Doctor ID and dividing the sum by a count of each record with the Doctor ID, As 
depicted in FIG 2, the Doctor IDs A, B, C and D are shown along with the expected cost. 
The Doctor ID A has the lowest expected cost ($100.00) and is therefore chosen as the 
peeling discrete attribute. 

Consequently, the PRIM calculation for discrete attributes is exactly as described 
above for continuous. However for discrete attributes, step 4) would include forming a 
histogram for each discrete attribute containing the distinct discrete attribute values and 
expected cost. Step 5) would include comparing the continuous attribute with the lowest 
average value to the discrete attribute with the lowest average value to determine the peeling 
attribute to be removed. 

The PRJM implementation described above must sort the relation table of data for 
each attribute one at a time for each peeling step. In addition, the relational table of data must 
be queried to determine the expected cost for each discrete attribute for each peeling step. 
These tasks require that the relational table of data be stored in main memory. Unfortunately, 
memory limitations of conventional systems prevent large disk resident data sets from being 
entirely sorted in main memory. Therefore, there is a need for an implementation of PRIM 
that is applicable to large, disk-resident data sets. There is also a need for an implementation 
of PRIM that can be parallelized for execution on parallel processors. 
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SUMMARY 



The invention overcomes the identified problems by providing a method for analyzing 
large disk resident data sets. Li a computer system having a large disk-resident data set, a 
method of analyzing the disk-resident data set using the Patient Rule hiduction Method 
(PRIM) is disclosed wherein a relational data table is initially received. The relational data 
table includes continuous attributes, discrete attributes, a meta parameter and a cost attribute. 
The cost attribute represents cost output values based on continuous attribute values and 
discrete attribute values as inputs. A hyper-rectangle is then formed which encloses a multi- 
dimensional space defined by the continuous attribute values and the discrete attribute values. 
The continuous attribute values and the discrete attribute values are represented as points 
within the multi-dimensional space. Once the hyper-rectangle is formed, PRIM is completed 
with a peeling phase and a pasting phase. A plurality of points along edges of the hyper- 
rectangle are then removed (peeled) based on an average of the cost output value from the 
plurality of points until a coxmt of the points enclosed within the hyper-rectangle equals the 
meta parameter. Discrete attribute values and continuous attribute values which were 



removed from the hyper-rectangle are next added ^edSfed) along edges of the hyper-rectangle 
until a sum of the cost output value over the multi-dimensional space enclosed by the hyper- 
rectangle changes. In a fiirther embodiment of the invention utilizing a parallel architecture 
computer system having a plurality of processors, calculations of the cost attribute average 
values over the plurality of points enclosed by the hyper-rectangle are performed in parallel 
across the plurality of processors using reduction and a one to all broadcast. 

The invention provides many advantages over known techniques. The present 
invention includes the ability to analyze large disk resident data sets without having to load 
the data set into main memory. In addition, the invention can be practiced on a parallel 
computer architecture or a symmetric multi-processor architecture to improve performance. 
Moreover, the memory requirements of the invention are only limited by the size of the cost 
attribute sought to be maximize or minimized. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Additional advantages and features of the invention will become readily apparent 
upon reading the following detailed description and appended claims when taken in 
conjunction with reference to the drawings, in which: 

Figure 1 is a plot depicting the hyper-rectangles determined using the methods of the present 
invention as compared to the prior art SLIQ invention; 

Figure 2 depicts data structures used by the Patient Rule Induction Method for analysis of 
small data sets; 

Figure 3 depicts a computer system according to an embodiment of the invention; 

Figure 4 is a flow chart depicting operation of the invention according to an embodiment of 
the invention; 

Figure 5 depicts additional method steps for defining the hyper-rectangle according to a 
further embodiment of the invention; 

Figure 6 depicts additional method steps for peeling procedures according to a further 
embodiment of the invention; 

Figure 7 depicts additional method steps for optimizing calculation of the lowest average 
cost output value according to a further embodiment of the invention; 

Figure 8 depicts additional method steps for the peeling procedures according to a further 
embodiment of the invention; 

Figure 9 depicts additional method steps for performing the pasting procedures according to 
a further embodiment of the invention; 
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Figure 10 depicts additional method steps for optimizing calculation of the highest average 
cost output value according to a further embodiment of the invention; 

Figure 1 1 depicts additional method steps for the pasting procedures according to a further 
embodiment of the invention; 

Figure 12 depicts a parallel computer architecture according to an embodiment of the 
invention; 

Figure 13 is a flow chart depicting operation of the Patient Rule Liduction Method in a 
parallel computer architecture; 

Figure 14 depicts data redistribution among the plurality of processors using striping 
according to an embodiment of the invention; 

Figure 15 depicts additional method steps for performing the peeling procedures according to 
a further embodiment of the invention; 

Figure 16 depicts additional method steps for performing the pasting procedures according to 
a further embodiment of the invention; 

Figure 17 depicts a symmetric multi-processor computer system according to an embodiment 
of the invention; 

Figure 1 8 is a flow chart depicting operation of the Patient Rule Liduction Method on a 
symmetric multi-processor computer architecture; 

Figure 19 depicts additional method steps for performing the peeling procedures according to 
a further embodiment of the invention; and 
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Figure 20 depicts additional method steps for performing the pasting procedures according to 
a further embodiment of the invention. 

DETAILED DESCRIPTION 

The present invention relates generally to data analysis involving the prediction of 
high values of some output variable based on a set of input variables. In particular, the 
invention relates to analysis of large, disk resident data sets using the Patient Rule Induction 
Method (PRIM). The PRIM method for large disk resident data sets includes two phases for 
generating a hyper-rectangle. These phases are the Peeling phase and the Pasting phase. We 
assume that the data is input as a relational data table. The relational data table contains A^. 
continuous attributes, A^j discrete attributes and a cost attribute or output value based on the 
A^. continuous attributes and A^ discrete attributes as input. In order to simplijfy this 
discussion, the term cost attribute is generally used to refer to output values based on 
continuous attribute values and discrete attribute values as inputs. In other words, a cost 
output value is an output based on a continuous attribute value and a discrete attribute value 
as inputs. Pq meta parameter given by the user. It represents the minimum number of 
points present in the hyper-rectangle. 

An exemplary embodiment of the invention is described with reference to Figures 3 
and 4. Figure 3 depicts a computer system 10 according to an embodiment of the invention. 
The computer system includes a processor (CPU) 12 coupled to a bus 14. A random access 
memory 16 and a hard disk memory 18 are also coupled to the bus 14 and are accessible by 
the processor. The hard disk 1 8 is configured to store programs and data necessary for the 
invention, as described below. An optional user interface 20 is provided for input of raw 
data. In one embodiment, the input/output devices include a keyboard, mouse, and monitor. 
An optional network interface 21 is also provided. It should be appreciated that raw data may 
be entered in various different ways, for example via the user interface 20 or the network 
interface 21. 
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The hard disk 18 is configured to store the program and data in the computer system 
10. The memory, including the RAM and the hard disk, is divided into three primary 
components: communications procedures 22, control procedures 28, and data 42. The 
communications procedures include routines 24 and 26 for identifying large disk resident data 
5 sets. The control procedures include routines 30-46 that perform data analysis functions 
according to the invention. The data portion creates indexes to an A^, continuous attribute 
lists and a discrete attribute list of the relational data table 54, and stores a cost list, and a 
meta parameter 50 in main memory (RAM) 16. These routines are described in greater detail 
below. 

10 

- Operation of the invention is described with reference to the Figure 4 flowchart. At 
step 102, a meta parameter and a relational data table are received. As described above, the 
% relational data table includes A^ continuous attributes, discrete attributes and a cost attribute. 

4- The cost attribute represents cost output values based on continuous attributes values and 

Ol5 discrete attribute values as inputs. The attributes are originally rows or tuples that form the 
jp relational data table which also contains an index to identify the tuple when the attributes are 

separated. At step 1 10, a hyper-rectangle is defined by enclosing a multi-dimensional space 
defined by the continuous attribute values and the discrete attribute values. To form the 
m multi-dimensional space, the continuous attribute values and the discrete attribute values are 

'io represented as points within the multi-dimensional space. At steps 130 and 200, a plurality of 
^ points along edges of the hyper-rectangle are removed (peeled) based on an average of the 

cost output value from the plurality of points. The points are repeatedly removed until a 
count of the points enclosed within the hyper-rectangle equals the meta parameter. Finally at 
steps 290 and 300, removed discrete attribute value points and the continuous attribute value 
25 points are added (pasted) along the edges of the hyper-rectangle until a sum of the cost output 
values over the multi-dimensional space enclosed by the hyper-rectangle changes. 

Figure 5 depicts additional methods steps for defining the hyper-rectangle of step 110 
according to a further embodiment of the invention. Figure 5 depicts vertical partitioning of 
30 the relational data table that enables analysis of the large disk resident data set without having 
to load the large disk resident data set into main memory 16 as required by conventional 
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systems. The data is separated into + 2 lists. At step 1 12, a list is generated for each 
continuous attribute to form continuous attribute lists containing the continuous attribute 
values. At step 1 14, a discrete attribute list containing the A^ discrete attributes and the 
discrete attribute values is generated. At step 1 16, a cost attribute list is generated containing 
5 the cost output values and is stored in main memory. At step 1 18, a label is added to each of 
the A^. continuous attribute lists, the discrete attribute list and the cost attribute list. The label 
is an index of the tuple to which the respective attribute value belongs within the relational 
data table. The index allows the continuous attribute values and discrete attribute values to 
reference their respective tuple and cost output value. 

10 

At step 120, a label is added to the cost list. The label is a cost flag that indicates 
whether the tuple containing the cost output value is enclosed within the hyper-rectangle. 
The cost flag is initially set to one indicating the tuple is enclosed within the hyper-rectangle, 
since all points are initially enclosed within the hyper-rectangle. Finally at step 122, a further 
015 label is added to the cost list. The label is a cost counter of the number of points of the tuple 
J that are not enclosed within the hyper-rectangle. The cost counter is initially set to one 

^ indicating since all points are initially enclosed with the hyper-rectangle. The cost counter is 

H used in the pasting procedures 42, 

^ ?:20 Figure 6 depicts additional methods steps for the peeling procedures 36 of step 200 

according to a further embodiment of the invention. At step 210, a discrete attribute value 
enclosed within the plurality of points along an edge of the hyper-rectangle with a lowest 
average cost output value is found. At step 220, the continuous attribute value enclosed 
within the plurality of points along an edge of the hyper-rectangle with a lowest average cost 

25 output value is found. At step 240, the lowest average cost output value determined in step 
210 is compared with the lowest average cost output value determined in step 220 to 
determine an attribute with the lowest average cost output value. At step 250, all continuous 
attribute value points and all discrete attribute value points of the tuples containing the 
attribute determined in step 240 are removed (peeled) from the hyper-rectangle. At step 270, 

30 steps 210 to 250 are repeated until the count of the points within the hyper-rectangle equals 
Po- 
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Finally at step 280, a total cost output is calculated. The total cost output is a sum of 
the cost output values over the multi-dimensional space enclosed by the hyper-rectangle. 
Although the peeling procedure described above is maximizing the points enclosed by the 
hyper-rectangle, the points enclosed by the hyper-rectangle could be minimized as well. In 
addition, the discrete attribute value of step 200 is, for example, determined using a plurahty 
of discrete histogram for each discrete attribute. Each histogram contains the respective 
distinct discrete attribute values and an average of the cost output value for each tuple 
containing the discrete attribute value. The average cost output value is calculated by using 
the index of the discrete attribute value and totaling each cost output value in the cost list 
with a matching index and the cost flag equal to zero. The total is then divided by a count of 
the cost output values in the total to form the average cost output value for the respective 
discrete attribute value. The discrete attribute value with the lowest average cost output value 
is then easily chosen by examining each discrete histogram. 

Figure 7 depicts additional methods steps for optimizing calculation of the lowest 
average cost output value of step 220 according to a further embodiment of the invention. 
Liitially, each continuous attribute list is sorted in increasing order with a start pointer to a 
first row in each continuous attribute list. At step 222, a second continuous attribute list is 
generated for each of the A^. continuous attribute lists. The second continuous attribute lists 
are sorted in decreasing order with an end pointer to a first row in each second continuous 
attribute list. At step 224, a start cutoff value is marked in each of the A^, continuous attribute 
lists based on a count of the tuples containing the discrete attribute value determined in step 
210 and enclosed within the hyper-rectangle. At step 226, an end cutoff value is marked in 
each of the second continuous attribute lists based on the count of the tuples containing the 
discrete attribute value determined in step 210 and enclosed within the hyper-rectangle. 

At step 228, a start cost average value is determined for each continuous output value 
between the start pointer and the cutoff value for each of the A^. cost attribute lists. At step 
230, an end cost average value is determined for each continuous output value between the 
cutoff value and the end pointer for each of the second cost attribute lists. At step 232, A^, 
continuous histograms, each containing the continuous attribute and the average cost output 
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value, are generated. The average cost output value is a lesser of the start cost average value 
and the end cost average value. Finally at step 234, the average cost output value for each 
continuous histogram is compared to determine the continuous attribute value with the lowest 
average cost output value. 

Figure 8 depicts additional methods steps for the peeling procedures 36 of step 250 
according to a further embodiment of the invention. In order to optimize this process, the 
discrete attribute list is sorted based on an assigned code thereby grouping the discrete 
attribute values according to their discrete attribute. At step 252, when the attribute 
determined in step 240 is a continuous attribute and the start cost average value is less than 
the end cost average value (step 254), the cost flag is set to zero for each continuous attribute 
value between the start pointer and the start cutoff value at step 256. The index of the 
continuous attribute value is used to reference and modify the cost flag. At step 258, the start 
pointer is set equal to the start cutoff value. At step 254, when the end cost average value is 
less than the start cost average value, the cost flag is set to zero for each continuous attribute 
value between the end cutoff value and the end pointer at step 260. The index of the 
continuous attribute value is used to reference and modify the cost flag. At step 258, the end 
pointer is set equal to the end cutoff value. At step 252, when the attribute determined in step 
240 is a discrete attribute, the cost flag is set to zero for each discrete attribute value equal to 
the attribute determined in step 240. The index of the discrete attribute value is used to 
reference and modify the cost flag. 

Figure 9 depicts additional methods steps for performing the pasting procedures 42 of 
step 300 according to a further embodiment of the invention. At step 310, for each tuple with 
the cost flag set to zero, the cost counter is incremented for each point belonging to the tuple 
that is not enclosed with the hyper-rectangle. The cost counter is used to determine whether a 
point is inside or outside the hyper-rectangle. At step 320, the discrete attribute value outside 
of the points enclosed by the hyper-rectangle with a highest average cost output value is 
determined. At step 330, the continuous attribute value outside of the points enclosed by the 
hyper-rectangle with a highest average cost output value is determined. At step 350, the 
highest average cost output value determined in step 320 is compared with the highest 
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average cost output value determined in step 330 to find an attribute with the highest average 
cost output value. Finally at step 360, the cost counter for all continuous attribute value 
points and all discrete attribute value points belonging to the tuples containing the attribute 
determined in step 350 are decremented. Attributes with the cost counter equal to zero are 
enclosed within the hyper-rectangle, otherwise the attribute is outside the hyper-rectangle, hi 
other words, incrementing of the cost counter removes attributes firom the hyper-rectangle, 
while decrementing of the cost counter to equal zero adds attributes to the hyper-rectangle. 
At step 370, steps 310 to 360 are repeated until a sum of the cost output values over the 
plurality of points enclosed by the hyper-rectangle is less than the total cost output. This 
pasting procedure ensures a more through representation of high value points. As describe 
above, the highest average cost output value of step 320 is calculated using a plurality of 
discrete histograms. 

Figure 10 depicts additional methods steps for optimizing calculation of the highest 
average cost output value of step 330 according to a further embodiment of the invention. At 
step 332, a the continuous attribute values between a first row of the A^. cost attribute lists and 
the start pointer are sorted in decreasing order. At step 334, a start cutoff value is marked in 
each of the A^ continuous attribute lists based on a count of the tuples containing the discrete 
attribute value determined in step 320 and enclosed within the hyper-rectangle. At step 336, 
an end cutoff value is marked in each of the second continuous attribute lists based on the 
count of the tuples containing the discrete attribute value determined in step 320 and enclosed 
within the hyper-rectangle. 

At step 338, a start cost average value is determined for each continuous output value 
between the start pointer and the cutoff value for each of the A^ cost attribute lists. At step 
340, an end cost average value is determined for each continuous output value between the 
cutoff value and the end pointer for each of the second cost attribute lists. At step 342, A^, 
continuous histograms, each containing the continuous attribute and the average cost output 
value, are generated. The average cost output value is a greater of the start cost average value 
and the end cost average value. Finally at step 344, the average cost output value for each 
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continuous histogram is compared to determine the continuous attribute value with the 
highest average cost output value. 

Figure 1 1 depicts additional methods steps for the pasting procedures 42 of step 360 
5 according to a further embodiment of the invention. In order to optimize this process, the 
discrete attribute list is sorted based on an assigned code thereby grouping the discrete 
attribute values according to their discrete attribute. At step 362, when the attribute 
determined in step 350 is a continuous attribute and the start cost average value is less than 
the end cost average value (step 364), decrement the cost counter for each continuous 
10 attribute value between the start pointer and the start cutoff value at step 366. The index of 
the continuous attribute value is used to reference and modify the cost counter. At step 368, 
the start pointer is set equal to the start cutoff value. At step 374, when the end cost average 

'^I value is less than the start cost average value, decrement the cost counter for each continuous 

attribute value between the end cutoff value and the end pointer at step 370. The index of 

015 the continuous attribute value is used to reference and modify the cost counter. At step 372, 

5 the end pointer is set equal to the end cutoff value. At step 362, when the attribute 

determined in step 350 is a discrete attribute, decrement the cost counter for each discrete 

H attribute value equal to the attribute determined in step 350. The index of the discrete 

m attribute value is used to reference and modify the cost counter. 

fto 

J3 A further embodiment of the invention is described with reference to Figures 12 and 

13. Figure 12 depicts a parallel architecture computer system 400 according to an 
embodiment of the invention. The computer system includes a plurality of processors 412A- 
412N coupled to a bus 414. A random access memory 416 for each processor 412 and a hard 

25 disk memory 41 8 are also coupled to the bus 414 and are accessible by the plurality of 

processors 412. The hard disk 418 is configured to store programs and data necessary for the 
invention, as described below. An optional user interface 420 is provided for input of raw 
data. In one embodiment, the input/output devices include a keyboard, mouse, and monitor. 
An optional network interface 421 is also provided. It should be appreciated that raw data 

30 may be entered in various different ways, for example via the user interface 18 or the network 
interface 20. 
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The hard disk 418 is configured to store the program and data in the computer system 
10. The memory, including the RAM and the hard disk, is divided into three primary 
components: communications procedures 422, control procedures 432, and data 452. The 
communications procedures include routines 424 - 430 for identifying large disk resident data 
sets and providing communication among the plurahty of processors. The control procedures 
include routines 434-450 that perform the invention's data analysis functions. The data 
portion creates indexes to an A^. continuous attribute lists and a discrete attribute list of the 
relational data table 454, and stores a cost list, and a meta parameter 456 in main memory 
(RAM) 416. These routines are described in greater detail below. 

Operation of the invention is described with reference to the Figure 13 flowchart. At 
step 502, a meta parameter and a relational data table are received. As described above, the 
relational data table is includes A^ continuous attributes, discrete attributes and a cost 
attribute. The cost attribute represents cost output values based on continuous attributes 
values and discrete attribute values as inputs. At step 504, a hyper-rectangle is defined by 
enclosing a multi-dimensional space defined by the continuous attribute values and the 
discrete attribute values. At step 506, the data is separated into A^. + 2 lists. A list is 
generated for each continuous attribute to form A^ continuous attribute lists containing the 
continuous attribute values A discrete attribute list containing the A^ discrete attributes and 
the discrete attribute values. A cost attribute list containing the cost output values is stored in 
main memory. Each of the A^, continuous attribute lists, the discrete attribute list and the cost 
attribute list also include a label. The label is an index of the tuple to which the respective 
attribute value belongs within the relational data table. The index allows the continuous 
attribute values and discrete attribute values to reference their respective tuple and cost output 
value. The lists also include a cost counter label. The cost counter is a count of the number 
of points of the tuple that are not enclosed within the hyper-rectangle as described above. 

At step 508, the A^ continuous attribute lists are sorted in parallel among the plurality 
of processors based on the continuous attribute values in each row of the cost attribute lists. 
At step 510, the attribute lists are stripe across the plurality of processors as depicted in 
Figure 14. At steps 512 and 520, a plurality of points along edges of the hyper-rectangle are 
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removed (peeled) based on an average of the cost output value from the plurality of points 
using reduction and a one to all broadcast with the plurality of processors. The points are 
repeatedly removed until a count of the points enclosed within the hyper-rectangle equals the 
meta parameter. Finally at steps 550 and 600, removed discrete attribute value points and the 
continuous attribute value points are added (pasted) along the edges of the hyper-rectangle 
until a sum of the cost output values over the multi-dimensional space enclosed by the hyper- 
rectangle changes using reduction and a one to all broadcast with the pluraHty of processors. 

Some synchronization steps may be required for getting the exact fraction of points 
for the continuous attributes. This is due to possibiHty of some continuous attribute values in 
an attribute list no longer being present inside the hyper-rectangle. Details concerning the 
communication and synchronization among the plurahty of processors will be apparent to 
those skilled in the art of parallel computer architectures and are therefore not set forth herein 
except as needed for a proper understanding of the invention. However, a reduction step for 
all the processors can be performed to get the average value for a particular attribute during 
the peeling phase. The best attribute can be selected for peeling. After the peehng has been 
performed the peeled transaction id's are transferred to each processor so that it can update 
the tags for its memory resident cost attribute list. Conventional reduction, implemented as a 
converse to the one to all broadcast, is well known in the field of parallel computing. 
{Introduction to Parallel Computing: Design and Analysis of Algorithms by Vipin Kumar, 
Ananth Grama, Anshul Gupta, and George Karypis Chapter 3, § 3.2.) 

Figure 15 depicts additional methods steps for the peehng procedures 440 of step 520 
according to a further embodiment of the invention. At step 522, a discrete attribute value 
enclosed within the plurahty of points along an edge of the hyper-rectangle with a lowest 
average cost output value is found using reduction among the processors. At step 524, the 
continuous attribute value enclosed within the plurality of points along an edge of the hyper- 
rectangle with a lowest average cost output value is found using reduction. At step 526, the 
lowest average cost output value determined in step 522 is compared with the lowest average 
cost output value determined in step 524 to determine an attribute with the lowest average 
cost output value. At step 528, all continuous attribute value points and all discrete attribute 
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value points of the tuples containing the attribute determined in step 526 are removed 
(peeled) from the hyper-rectangle using a one to all broadcast between the processors. At 
step 530, steps 522 to 528 are repeated until the count of the points within the hyper-rectangle 
equals |3q. 

Finally at step 532, a total cost output is calculated. The total cost output is a sum of 
the cost output values over the multi-dimensional space enclosed by the hyper-rectangle. 
Although the peeling procedure described above is maximizing the points enclosed by the 
hyper-rectangle, the points enclosed by the hyper-rectangle could be minimized as well. As 
describe above, the lowest average cost output value of step 520 can be calculated using a 
plurality of discrete histograms. 

Figure 16 depicts additional methods steps for performing the pasting procedures 440 
of step 600 according to a further embodiment of the invention. At step 602, for each tuple 
with the cost flag set to zero, incrementing the cost counter for each point belonging to the 
tuple that is not enclosed with the hyper-rectangle. At step 604, the discrete attribute value 
outside of the points enclosed by the hyper-rectangle with a highest average cost output value 
is determined using reduction and a one to all broadcast between the processors. At step 606, 
the continuous attribute value outside of the points enclosed by the hyper-rectangle with a 
highest average cost output value is determined using reduction and a one to all broadcast 
between the processors. At step 608, the highest average cost output value determined in step 
604 is compared with the highest average cost output value determined in step 606 to find an 
attribute with the highest average cost output value. Finally at step 300, the cost counter for 
all continuous attribute value points and all discrete attribute value points belonging to the 
tuples containing the attribute determined in step 608 are decremented using a one to all 
broadcast between the processors. Attributes with the cost counter equal to zero are enclosed 
within the hyper-rectangle. At step 612, steps 602 to 610 are repeated until a sum of the cost 
output value over the plurahty of points enclosed by the hyper-rectangle is less than the total 
cost output. This pasting procedure ensure a more through representation of high value 
points. As describe above, the highest average cost output value of step 604 is calculated 
using a plurality of discrete histograms. 
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A further embodiment of the invention is described with reference to Figures 17 and 
18. Figure 17 depicts a synametric multi-processor computer system 700 according to an 
embodiment of the invention. The symmetric multi-processor (SMP) 712 coupled to a bus 
714. A random access memory 716 and a share hard disk memory 717 are also coupled to the 
bus 714. The shared disk 717 is partitioned into a plurality of portion that are accessible by 
the symmetric multi-processors 712. The main memory (RAM) 716 is configured to store 
programs and data necessary for the invention, as described below. An optional user 
interface 718 is provided for input of raw data, hi one embodiment, the input/output devices 
include a keyboard, mouse, and monitor. An optional network interface 721 is also provided. 
It should be appreciated that raw data maybe entered in various different ways, for example 
via the user interface 720 or the network interface 721. 

The hard disk 718 is configured to store the program and data in the computer system 
700. The memory, including the RAM and the hard disk, is divided into three primary 
components: communications procedures 722, control procedures 732, and data 752. The 
communications procedures include routines 724 - 730 for identifying large disk resident data 
sets and providing communication for the symmetric multi-processors 712. The control 
procedures include routines 735-754 that perform the invention's data analysis functions. 
The data portion creates indexes to an A^ continuous attribute lists and a discrete attribute hst 
of the relational data table 754, and stores a cost list, and a meta parameter 762 in main 
memory (RAM) 716. These routines are described in greater detail below. 

Operation of the invention is described with reference to the Figure 18 flowchart. At 
step 802, a meta parameter and a relational data table are received. As describe above, the 
relational data table is includes A^ continuous attributes, discrete attributes and a cost 
attribute. The cost attribute represents cost output values based on continuous attributes 
values and discrete attribute values as inputs. At step 804, a hyper-rectangle is defined by 
enclosing a multi-dimensional space defined by the continuous attribute values and the 
discrete attribute values. At step 806, the data is separated into A^, + 2 lists. A list is 
generated for each continuous attribute to form A^ continuous attribute lists containing the 
continuous attribute values A discrete attribute hst containing the A^ discrete attributes and 
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the discrete attribute values. A cost attribute list containing the cost output values is stored in 
main memory. Each of the continuous attribute lists, the discrete attribute hst and the cost 
attribute list also include a label. The label is an index of the tuple to which the respective 
attribute value belongs within the relational data table. The index allows the continuous 
5 attribute values and discrete attribute values to reference their respective tuple and cost output 
value. The lists also include a cost counter label. The cost counter is a count of the number 
of points of the tuple that are not enclosed within the hyper-rectangle as described above. 

At step 808, the A^ continuous attribute lists are sorted in parallel among the plurality 
10 of shared disk portions based on the continuous attribute values in each row of the cost 
attribute lists. At step 810, the attribute lists are stripe across the plurality of shared disk 
portions as depicted in Figure 14. At steps 812 and 820, a plurality of points along edges of 
% the hyper-rectangle are removed (peeled) based on an average of the cost output value from 

+! the plurality of points using reduction and a one to all broadcast within the symmetric multi- 

OL 5 processors. The points are repeatedly removed until a count of the points enclosed within the 
5 hyper-rectangle equals the meta parameter. Finally at steps 850 and 900, removed discrete 

attribute value points and the continuous attribute value points are added (pasted) along the 
edges of the hyper-rectangle until a sum of the cost output values over the multi-dimensional 
ry space enclosed by the hyper-rectangle changes using reduction and a one to all broadcast 

^^0 within the symmetric multi-processors. 

Figure 19 depicts additional methods steps for the peeling procedures 740 of step 820 
according to a ftirther embodiment of the invention. At step 822, a discrete attribute value 
enclosed within the pluraUty of points along an edge of the hyper-rectangle with a lowest 

25 average cost output value is found using reduction within the symmetric multi-processor. At 
step 824, the continuous attribute value enclosed within the plurahty of points along an edge 
of the hyper-rectangle with a lowest average cost output value is found using reduction. At 
step 826, the lowest average cost output value determined in step 822 is compared with the 
lowest average cost output value determined in step 824 to determine an attribute with the 

30 lowest average cost output value. At step 828, all continuous attribute value points and all 

discrete attribute value points of the tuples containing the attribute determined in step 826 are 
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removed (peeled) from the hyper-rectangle using a one to all broadcast within the symmetric 
multi-processors. At step 830, steps 822 to 828 are repeated until the count of the points 
within the hyper-rectangle equals Pq. Finally at step 832, the total cost output is calculated as 
described above. As describe above, the lowest average cost output value of step 520 can be 
calculated using a plurahty of discrete histograms. 

Figure 20 depicts additional methods steps for performing the pasting procedures 746 
of step 900 according to a further embodiment of the invention. At step 902, for each tuple 
with the cost flag set to zero, incrementing the cost coimter for each point belonging to the 
tuple that is not enclosed with the hyper-rectangle using a one to all broadcast within the 
symmetric multi-processors. At step 904, the discrete attribute value outside of the points 
enclosed by the hyper-rectangle with a highest average cost output value is determined using 
reduction and a one to all broadcast within the symmetric multi-processors. At step 906, the 
continuous attribute value outside of the points enclosed by the hyper-rectangle with a highest 
average cost output value is determined using reduction and a one to all broadcast within the 
symmetric multi-processors. At step 908, the highest average cost output value determined in 
step 904 is compared with the highest average cost output value determined in step 906 to 
find an attribute with the highest average cost output value. Finally at step 910, the cost 
counter for all continuous attribute value points and all discrete attribute value points 
belonging to the tuples containing the attribute determined in step 908 are decremented using 
a one to all broadcast within the symmetric multi-processors. Attributes with the cost counter 
equal to zero are enclosed within the hyper-rectangle. At step 912, steps 902 to 910 are 
repeated until a sum of the cost output value over the plurality of points enclosed by the 
hyper-rectangle is less than the total cost output. This pasting procedure ensure a more 
through representation of high value points. As describe above, the highest average cost 
output value of step 904 is calculated using a plurality of discrete histograms. 

Exemplary embodiments have been described with reference to specific 
configurations. Those skilled in the art will appreciate that various changes and 
modifications can be made while remaining within the scope of the claims. It is to be 
understood that even though numerous characteristics and advantages of various 
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embodiments of the present invention have been set forth in the foregoing description, 
together with details of the structure and function of various embodiments of the invention, 
this disclosure is illustrative only, and changes may be made in detail, especially in matters of 
structure and arrangement of parts within the principles of the present invention to the full 
5 extent indicated by the broad general meaning of the terms in which the appended claims are 
expressed. 

For example, it is within the contemplation of the present invention to practice the 
invention with a conventional computer without departing from the scope of the invention. 
1 0 Moreover, teaching of the present invention are not limited to maximization of some output 
value over a multi-dimensional space of input values. The invention may be practiced by 
minimizing the points over the multi-dimensional space without departing from the scope of 
the invention, 

015 The invention provides many advantages over known techniques. The present 

5 invention includes the ability to analyze large, disk resident data sets without having to load 

the data set into main memory. Li addition, the invention can be practiced on a parallel 
H computer architecture or a symmetric multi-processor architecture to improve performance, 

fjj Moreover, the memory requirements of the invention are only limited by the size of the cost 

^^^0 attribute sought to be maximized or minimized. 

Having disclosed exemplary embodiments and the best mode, modifications and 
variations may be made to the disclosed embodiments while remaining within the scope of 
the invention as defined by the following claims. 
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